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ABSTRACT 

This program, funded by the State of Michigan, was 
designed to provide compensatory education in basic reading and 
arithmetic skills for elementary school children with serious 
deficiencies in these areas. The composite achievement scores of the 
197 0-71 Michigan Educational Assessment Program were used to 
establish eligible school districts. Minimum performance objectives 
of at least one month's gain in achievement for each month pf 
instruction as measured by approved pre- and posttest instruments 
were established for each student in the program. In order for each 
school district to receive the full allocation per pupil of $20 0, 
each student must achieve 75 percent of the specified objective, s. 
Funds were allocated to those districts with the highest 
concentration of students achieving at the 15th percentile or 
below — .112, 500 children in 740 schools in 67 districts — and were used 
for payment of salaries for qualified teachers, aides, counselors, 
social workers, for educational materials and equipment, and for 
special training for teachers and other staff members. The program's 
objectives of increasing basic skills in reading and arithmetic were 
realized such that a lareg percentage of students who previously had 
performed below average can perform at an average or above average 
pace when programs are designed to meet their needs. (ST) 
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FOREWORD 



We are pleased to present Report Number 2, the 
second of two reports providing a description and eval- 
uation of the 1971-72 Section 3 compensatory education 
programs in Michigan. 

This document is intended to provide legislators, 
educators and citizens with inforaation regarding the 
19 71-72 Section 3 programs. 

This report has been prepared by Dr. Maureen A. 
Sie; questions or requests for additional information 
relative to the data contained in this report may be 
directed to her at Research, Evaluatioa and Assessment 
Services, Michigan Department of Education. 

John W. Porter 



Superintendent 
of 

Public Instruction 
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OVERVIEW 



"The first results from Michigan's $22.5 million 'accountability 
model' for compensatory education appear to dispute the contention that 
these programs cannot succeed. Under the state-funded 'comp. ed.' pro* 
gram, schools establish performance objectives, representing at least 
one grade level gain, for participating students. The program now 
reaches 112,000 elementary school children who rank in the bottom 15th 
percentile in mat'.i and reading in 67 school districts. In order for 
the school distri it to receive a full $200 per pupil grant in subsequent 
years, each student must achieve at least 75 percent of the specified 
objectives 

Education USA, December 18, 1972 

The Michigan state legislature appropriated $22,500v000 for compen- 
satory education during the 1971-72 school year under Section 3 of the 
State School Aid Act. The money was to be used to improve the reading 
and arithmetic skills of children with serious deficiencies in these 
areas and could not be used to supplant local expenditures. 

The composite achievement scores of the 1970-71 Michigan Educational 
Assessment Prograir* were used to establish eligible school districts. 
Money was allocated to districts at the rate of $200 per eligible pupil 
beginning with the district that had the highest concentration of stu* 
dents achieving at the 15th percentile or below on the assessment tests. 
This procedure was followed until all available funds were spent. There 
was sufficient money to cover 112,500 children in 740 schools in 67 districts. 

There were two questions to be tested in the state's compensatory 
education program.: 1) Can school districts be held accountable for 
educating the lowast-achieving pupils in their schools? and 2) Will the 
injection of additional funds for compensatory education improve the 
basic skills of low-achieving pupils? 
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Basically, the Section 3 program is a three-year perfrrmance con- 
tract between the school district and the state. Each of the eligible 
67 school districts had to submit a proposal describing its goals, 
objectives and instructional processes. Minimum accomplishment objectives 
— at least a month's gain for every month of instruction — were estab- 
lished as performance objectives for each student in the program. 

For each pupil achieving 75 percent of the accomplishment level, the 
school district would receive a full allocation per pupil for the following 
fiscal year. For each pupil achieving less than 75 percent of the accomplish- 
ment level, the district would receive an amount proportional to the gains 
attained. 

Because of che late implementation of the compensatory education 
program — it was funded in October of 1971 — the Legislature authorized 
a one-year waiver of fiscal accountability, and thus there will be no 
penalty in 1972-7.3, for children achieving less than 75 percent of the 
accomplishment level during the 1971-72 school year. 

The State Board of Education expected that basic skills programs would 
be designed to meet the particular educational needs of the children to be 
servec. Imaginative thinking and new approaches in the design of reading 
and arithmetic programs were encouraged. 

Some of the ways that Section 3 funds were to be used included the pay- 
ment of salaries for qualified teachers, aides, counselors, social workers, 
and other staff members when they were added to the regular staff to improve 
the educational program for the Section 3 students. School districts might 
also purchase additional educational materials and equipment. Schools' might 
offer special training for teachers, aides and other staff members. The 
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actual expenditures did not differ radically from these suppositions (see 
the Tables in the body of the report for details). 

Section J rules stipulate (rule 3b) that, ''the district - I 
include in its application a commitment that its minimum performance 
objective shall be an increase in achievement equivalent to one year's 
growth as specified in the performance objectives for this program as 
measured by approved pre- and post test instruments." 
Tables A and B summarize student achievement. 

Among the students with matched pre" and posttest scores , 
iiore than half of the students achieved at or above the 100 percent of 
accomplishment level , that is at least one month gain in achievement per 
month in the program. 

Twenty-eiRht percent of the students achieved at or above the 
200 percent accomplishmeuf level , which can be interpreted as at least 
two months gain p^^r month in the program. 

Twelve j^arcent of theso students made the 300 percent of 
accomplishment level or above , which is to say that they gained at least 
3 months per month in the program. 

Sixty-six percent of the Section 3 studetns, for whom matched 
pre- and posttest 5 ;cores were available, achieved the 75 percent or above 
accomplishment level (the level at which full funding would be continued 
for another year if districts had been held fiscally accountable)* For example, 
students who participated in the Section 3 program for eight months and gained 
six months in achievement scores would be considered to have met the 75 
percent accomplishment level. 

Assuming that, in general, normally progressive students achieve one year's 
growth as they advance from a lower gra 'e to a higher grade each year, these 
E[^C data indicate that a large percentage of students who previously had performed 



"1 
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below average can p erform at an average or above average pa:e when program s 
are designed to meet their needs. 

It should be noted that the data contained in this report are based 
on the results of standardized norm-referenced achievement tests which were 
administered to Section 3 students by local school districts and reported 
to the Department of Education. Local school districts selected tests with- 
in guidelines established by the Michigan Department of Education and admin- 
istration of the tests was controlled locally. Some of the problems associ- 
ated with implementation and testing were discussed in A Description and 
Evaluation of Section 3 Programs in Michigan 1971-72, Report Number One .-*- 

At this time, it is not known what caused the significant improvement 
in achievement by some students. In order to make such a determination, 
further information is needed on: (1) the effectiveness of planned educa- 
tional delivery systems; and (2) the relationship between costs and .effective- 
ness of a planned delivery system. As a next step in the evaluation of com- 
pensatory education, staff of the Department are presently seeking support to 
develop, test and ultimately implement a procedure designed to provide such 
information. 



1. For a more thorough discussion of this and other limitations, see 
A Description and Evaluation of Section 3 Programs in Michigan 1971-72 ^ 
Report Number 1 , pages 13-20. 
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TABLE A 

SUMMARY OF STUDENT ACHIEVEMENT 



SCHOOL DISTRICT 


STATE TOTAL 
EXCLUDING DETROIT 


DETROIT 


STATE TOTAL 


NUMBER OF SECTION 3 PUPILS 


53,233 


59,267 


112,500 




N 


'0 


N 


y. 


N 


% 


PUPILS ACHIEVING 75% - ABOVE 


31,865 


65.52 


30,271 


66.59 


62,136 


66.04 


PUPILS ACHIEVING 1% - 74.99% 


9,542 


19.63 


7,732 


17.01 


17,274 


18.36 


PUPILS ACHIEVING 0% - BELOW 


7,221 


14.85 


7,452 


16.40 


14,673 


15.60 


TOTAL 


48,628 


100,00 


45,455 


100.00 


94,083 


100.00 


PUPILS RECEIVING LESS THAN 
ISO DAYS OF INSTRUCTION 
(e.g., illness, transfer, etc.) 


504 


0 


504 


MISSING OR UNREPORTED DATA 


4,101 


13,812 


17,913 



o 
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TABLE B 

SUMMARY OF PUPIL ACHIEVEMENT BY PERCENT OF ACCOMPLISHMENT 

(STATE TOTALS) 
FOR PUPILS WITH MATCHED PRE- AND POSTTESTS, 1971-72 



r 61. cent, 
of 


Wi tmK ^T* ri"? .^f"itH f" c 

I^iLlUILfC^ \J 1, tJ L LlLl CLl CO 

at 

T7ar»Vi T ^"vr^l 


Ppfr/^nf o£ Tntfll Students 

at 

KapH Level 


300% And above 


11,871 


12.62% 


200 - 299% 


14,939 


15,87% 


100 - 199% 


28,720 


30.53% 


75 - 99% 


6.606 


7.02% 


Subtotal 75% and above 


62,136 


66.04% 


50 - 74% 


7,815 


8.31% 


25 - 49% 


5,276 


5.60% 


1 - 24% 


4,183 


4.45% 


Subtotal 1-74% 


17,274 


18.36% 


0% and below 


14,673 


15.60% 



2. Data in this table are based on 94,083 students with matched pre- and 
posttest scores • Not included are: 17,913 students with missing or unreported 
data and 504 students who received less than 150 days of instruction* 



3. Percent of Accomplishment equals 1 month gain per 1 month in the program. 
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PART I 

DESCRIPTION OF DATA COLLECTED 



For the school year 1971-72, individual pupil test results, as well as 
related information on instructional programs and financial expenditures 
from the school, were collected and analyzed to determine the outcomes 
of Section 3 programming. Successful programs by school buildings and 
by districts were identified. Information concerning pupil achievement, 
expenditures, funding levels, programs, program duration, etc. are dis- 
cussed in this report. 

In this, the second of two reports on the 1971-72 Section 3 Program, 
the major emphasis has been placed on the analysis and interpretation 
of results which comprised both educationally and statistically significant 
findings. The major sections of this report include: I - Description of 
Data Collected; II - Description of Section 3 Students Achievement in 
Reading and Arithmetic; III - Combined Results on Program Variables Analysis 
for All Section 3 School Districts - Excluding Detroit; IV - Results on Program 
Variables Analysis for the Detroit Public Schools; V - Comparison Study of High 
Achieving and Low Achieving School Districts; and VI - Discussion & Recoramenations. 

The total number of students funded under Section 3 for fiscal year 
1971-72 was 112,500. The total count of records submitted by the 67 Sec- 
tion 3 school districts was 99,736, of which there were 94,083 students wJ.th 
matched pre- and posttest scores. Detroit Public Schools reported 45,455 
students with matched pre- and posttest scores, or 77% of the total eli- 
gibles. The total number of students with matched test scores in the 66 
Section 3 schools excluding Detroit was 48,628 or 91% of a total of 53,233 
students funded under Section 3. 
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Nineteen of the 67 school districts submitted information on pupil 
replacements for pupils leaving the district, students attending less than 
150 days of instruction, and students transferred. The total number of 
students reported under the aforementioned categories came to 504. 

Each district submitted to the Michigan Department of Education a 
summary of expenditures report. These reports indicated that Section 3 ex- 
penditures in some school districts exceeded the allocated funds, and con- 
versely, some districts underspent. Generally speaking, the discrepancies 
were small. 

Quality of Data Collected 

The problem of "regression-to-the-mean effect" was taken into account 
by rule 4 (1) which states that "A pretest shall be administered in each 
area of basic cognitive skills in which a pupil participates. The pre- 
test scores shall not be used to determine eligibility to participate..." 
Thus, for school year 1971-72 Section 3 programs, test scores used for 
selection purposes could not be used as pretest scores. :/ 

In December 1971, audit visitations were made by the Michigan Department 
of Education (MDE) staff to review the selection procedures and pretest 
results. The results were presented in A Description and Evaluation of 
Section 3 Programs in Michigan 1971-72 > Report Number 1 .^ The MDE staff 
assisted local school district personnel in various phases of planning and 
implementing the Section 3 programs. -In addition, management workshops and 
the publication and distribution of Section 3 guidelines further clarified 
the administrative and evaliiation aspects of the program for the benefit of 
Section 3 school districts. 

'+rhis report is available from Research, Evaluation and Assessment Services, 
Michigan Department of Education, Lansing, Michigan. 



The 1971 Michigan Educational Assessment Program scores were used as 
an independent chei:k on the validity of the Section 3 pre- and posttest 
scores. Correlation coefficients of Section 3 reading pretest scores and 
assessment reading scores. Section 3 arithmetic pretest scores and assess- 
ment math scores, Section 3 reading posttest scores and assessment reading 
scores, and Section 3 arithmetic posttest scores and assessment math scores 
were computed for Section 3 fourth grade students in each school. The 
analysis was performed for schools in the eighteen most populous school 
districts including Detroit. 

Section 3 school districts used, with very few exceptions, nationally 
normed achievement tests such as the Stanford Achievement Test, the 
Metropolitan Achievement Test, the California Achievement Test, Science 
Research Achievement Series, and the Iowa Test of Basic Skills. 

The following school districts seemed consistently to have significant 
correlation coefficients: Benton Harbor, Albion, Jackson, Grand Rapids, 
Muskegon Heights, Pontiac and Detroit. The following districts have signi- 
ficant correlation coefficients with respect to certain school buildings 
in the districts: Flint, Lansing, Kalamazoo, Saginaw, Inkster, Romulus, 
and Wayne Westland. The following school districts have many buildings 
which showed insignificant correlation coefficients: Battle Creek, Beecher 
and Muskegon. 

Further analysis was done on high achieving students, making more than 
Ih years gains, and low achieving students, making less than 3 months gains, 
in each district. The correlation on the two groups showed that there was 
high correlation between pre- and posttest scores for students in grades 3 
through 6 in both reading and arithmetic. Generally they were in the .80's 
and .90 's, with some exceptions In about ten school districts, which showed 
correlation coefficients between .19 and .57. This in no way 
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is to suggest that the data collected in the ten school districts are not 
an accurate reflection of pupil achievement. 

To summarize the preceding paragraphs, the staff of the Department and 
the staff of local education agencies have worked together in an attempt to 
gain valid data. Numerous workshops have been held, guidelines established, 
and technical assistance provided by Department staff. 

Status of Pupil Achievement on the Pre- and Posttest 

Each student's grade score (grade score is the grade equivalent minus 
the decimal, e.g., a grade equivalent score of 5.3 becomes a grade score of 
53) was checked in an attempt to identify students wfio were not functioning 
at least one year below grade level in pretesting. The aggregate number of 
students by districts who were not achieving at least one year below grade 
level on the pretest are presented in Appendix A. 

In assessing the status of pre- and posttest data of Section 3 students, 
only those students having grade scores for both tests were considered. 
Students in grades K, 1 and sometimes 2 were given readiness tests which do 
not yield grade scores. The grade level of each student was used as a 
reference point, a value "X" then was compared to the student's pretest 
grade score; if the pretest grade score was greater than the obtained value, 
he was considered as not meeting the criterion of one year below grade 
level. 

The posttest usually was administered to students in May. Using grade 
level as a reference point, if a student achieved a posttest grade score 
which was equal to or greater than his grade level plus .8^, the student 
was considered achieving on or above his grade level. The aggregate 

^or this analysis .8 was used as the expected normal growth during the 
school year based on national test norms. 
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statlstlcs are shown In Appendix A. 

Expenditures of Section 3 Progra m 

A total expenditure of $21,303,983.67 was reported to the Michigan 
Department of Education by 67 Section 3 school districts for school year 
1971-72. Under the regular school year program $12,712,225.98 or 59.7% 
was spent in salaries and inservice training; $6,859,595.65 or 32.2% was 
spent In teaching materials; $819,343.93 or 3.8% was spent on facilities; 
and $912,818.13. or 4.3% was spent for administrative services. In addi- 
tion, the 1972 summer session expenditure was $463,419.74. The first 
report, A Description and Evaluation of Section 3 Programs In Michigan for 
School Year 1971-72 , Report Number 1 , was published In December, 1972. 
The expenditure report of Detroit Public Schools was not available at that 
time. Therefore, the preliminary results of expenditures for Section 3 
programs reported In Report Number 1 were based on 66 Section 3 school dis- 
tricts. Table 1 shows the tabulated values of the Section 3 expenditures 
from these school districts. The four main categories of expenditures are: 
teaching expenditures which Include salaries for Instruction and Inservice 
training* materials; facilities and administrative services. 

Table 2 shows the expenditures for all 67 Section 3 school districts, 
including Detroit. A comparison of the four main categories of expenditures 
under the regular school year between the state total (Table 2) and the 
state total excluding Detroit Public Schools (Table 1) shows that there Is 
little change In the spendlx^g pattern under teacher expenditures, materials, 
facilities, and administrative services. 

The changes in the 1972 summer school expenditures between the state 
total and the state total excluding Detroit are more marked, 80.0% vs. 52.7% 
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under teaching expenditures, 14.3% vs. 9.4% under materials, 0.3% vs. 
0.5% under facilities and 5.2% vs. 37.6% under administrative services. 

The tabulated values of the Section 3 expenditures from the Detroit 
School District are shown separately in Table 3- A comparison of the 
expenditures of the Detroit Public Schools and the remaining 66 Section 3 
school districts revealed that under regular school programs, the spending 
patterns are similar. However, the summer school program shows that the 
Detroit Public Schools spent their funds for administrative services and 
the other 66 Section 3 school districts spent most of their funds for teaching 
expenditures. It should be noted, however, the summer expenditures in Detroit 
constituted approximately 1.3% of the total allocation of $11,853,400.00 for 
that district. Figures 1 and 2 illustrate the spending patterns. 

Summary 

In this section an account and description of data collected on the 
school year 1971-72 Section 3 program was presented. Among the 112,500 
Section 3 pupils, there were 94,083 with matched pre- and posttest scores. 

The Detroi't Public Schools provided matched test scores for 45,455 stu- 
dents, or 77% of their eligible students; the remaining 66 Section 3 school 
districts provided matched test scores for 48,628 students, or 91% of their 
eligible students. 

The problem of "regression-to-the-mean effect" was taken into account 
by requiring the school districts to administer to their students a pre- 
test after the students were selected for participation in the Section 3 
programs based on screening test scores. 

On-site visits were made by the MDE staff to review selection procedures 
and pretest results. Workshops were conducted and guidelines were distributed 
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TABLE 1 

TABULATED VALUES OF THE SECTION 3 EXPENDITURES FROM 66 DISTRICTS - EXCLUDING 

DETROIT 



Regular SY 1971-72 



Summer Session 1972 



Teachl-ng Expenditures 

Salaries for 
Instruction 

In-service 
Training 

Materials 



5,830,847.67 
204,587.31 



Teaching Supplies 1,350,121.28 
Textbooks 
Supplementary 



Materials 

School Library 
Books 

Educational TV 

Audiovisual 

All Other In- 
structional 
Equipment 

Facilities 

Operation of Plant 
Maintenance of Plant 
Fixed Charges 
Food Services 
Construction 
All Non-instruc- 
tional Equipment 

Administrative Services 

Administration 
Attendance Services 
Health Services 
Student Body 
Activities 
Community Services 
Transportation 



375,463.67 
799,996.95 



20,896.35 
2,529.50 
194,399.86 



644,746.04 



4,495.36 
4,123.97 
99,671.66 
2,902.02 
161,398.79 

51,979.13 



326,931.23 
150.00 
254.90 

2,520.00 
758.24 
26,193.74 



6,035,434.98 



3,388,153.65 



324,570.93 



356,808.11 



59.8 



33.5 



3.2 



3.5 



204,102.40 
39,760.10 

29,445.30 
14,147.74 



700.00 
800.00 



13,518.20 

1,500.00 
720.00 



243,862.50 80.0 



43,593.04 14.3 



1,500.00 0.5 



15,738.20 5.2 



TOTALS ; 



10,104,967.67 100.0 



304,693,74 100.0 



*The Detroit school district is not included in this table. 
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TABLE 2 



TABULATED VALUES OF THE SECTION 3 EXPENDITURES FROM ALL 67 DISTRICTS - 

INCLUDING DETROIT 



Regular SY 1971-72 _ % Summer Session 1972 % 



Teaching Expenditures 




12,712,225.98 


59.7 




243,862.50 


52.7 


Salaries for 
Instruction 

ni*"service 
Training 


12,387,123.67 
325,102.31 






204,102.40 
39,760.10 






Materials 




6,859,595.65 


32.2 




43,593.04 


9.4 


Teaching Supplies 

Textbooks 

S upplemen tar y 

Materials 
School Library Books 

Vr\jinati nnf^l TV 
rjUUCclUJLtJIlclX J. V 

Audiovisual 
All Other In- 
structional Equip. 


3,655,131.28 
375,463.67 

799,996.95 
20,896.35 

1,151,797.86 

853,780.04 






29,445.30 
14,147.74 






Facilities 




819,343.93 


3.8 




1,500.00- 


0.3 


Operation of Plant 
Maintenance of Plant 
Fixed Charges 
Food Services 
Construction 
All Non- instructional 
Equip . 


4,495.36 
4,123.97 

450,478.66 
2,902.02 

305,364.79 

51,979.13 






700.00 
800.00 






Administrative Services 




912,818.11 


4.3 




174,464.20 


37.6 


Admini s t r a t i on 
Attendance Services 
Health Services 
Student Body 
Activities 
Community Services 
Transportation 


866,396.23 
150.00 
254.00 

2,520.00 
758.24 
42,738.74 






172,244.20 

1,500.00 
720.00 




c 

t 


TO'J'ALS : 


21,303,983.67 


100.0 




463,419.74 


100.0 



\ • 



ERIC 
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TABLE 3 

TABULATED VALUES OF THE SECTION 3 EXPENDITURES FROM THE DETROIT SCHOOL DISTRICT 



Regular SY 1971-72 1 



T each Ing E xpenditures 

Saliirles for 
Instruction 
X In-service 
Training 

Materials 

Teaching 

Supplies 
Textbooks 
Supplementary 

Materials 
School Library 

Books 
Educational TV 
Audiovisual 
All Other 

Instructional 

Equipment 

Facilities 

Operation of 

Plant 
Maintenance of 

Plant 
Fixed Charges 
Food Services 
Construction 
All Non- 
instructional 
Equipment 



Administrative Services 

Adminis tration 
Attendance 

Services 
Health Services 
Student Body 

Activities 
Community 

Services 
Transportation 



6,556,276.00 
120,515.00 



2,305,010.00 



957,398.00 



209,034.00 



350,807.00 
143,966.00 



539,465.00 



ERIC 



16,545.00 
TOTALS : 



6,676,791.00 59.7 



3,471,442.00 30.9 



494,773.00 



4.5 



556,010.00 



4.9 



11,199,016.00 100.0 



Summer Session 1972 



158,726.00 



100.0 



158,726.00 



158,726.00 100.0 



Figure 1 7"-^^ 
SUMMARY OF EXPENDITURES FOR SCHOOL YEAR 1971-72 



REGULAR SCHOOL YEAR 




TEACHING 
EXPENDITURES 



MATERIALS 



FACILITIES 



ADMINISTRATION 
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to facilitate the Implementation of Section 3 programs. 

The 1971 Michigan Educational Assessment Program scores served as an 
Independent check on the Section 3 test scores of fourth grade pupils. The 
pre- and posttest scores of high and low achieving students were correlated. 
Generally the correlation coefficients were found to be high in some dis- 
tricts, mixed in some districts, and low in some districts. 

The status of individual pupils pre- and posttest scores were checked. 
Although most students were low-achieving, some were not functioning at one 
or more years below grade level. In checking posttest scores, it was found 
that a relatively small number of students was performing at or above grade 
level . 

The spending patterns of most Section 3 school districts were quite 
similar. Under regular school programs, school districts spend approximately 
60% of their allocations on salaries for instruction and inservlce training, 
approximately 30% of their allocations on materials, 3 to 5% on facilities 
and 4 to 5% on administrative services. 
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PART II 

DESCRIPTION OF SECTION 3 STUDENT 
ACHIEVEMENT IN READING AND ARITHMETIC 

The difference between pre- and posttest reading and arithmetic achieve- 
ment scores were computed to ascertain the levels of accomplishment. The 
criterion for success in accomplishment was established as one month gain 
in grade equivalent scores for each month in the program. 

Number and Percent of Students Achieving at Various Levels of Accomplishment 

The number and percent of students achieving at various levels of 
accomplishment were computed for each school and each district. Since the 
completion of the preliminary report, the master data tape has been updated 
several times and the percentage of accomplishment table has been modified 
and extended upward to include 300% and above instead of 100% and above as 
reported previously. As a result of these changes, the results of all 67 
Section 3 school districts are presented in this report (Appendix B) . 
Summary figures as shown in Table 4 are: (1) all 67 Section 3 districts, 
(2) the 66 districts excluding Detroit, and (3) the Detroit public schools. 
From this summary table, it is clearly indicated that^ if the school districts 
had been held fiscally accountable for 1971-72, Detroit would have received no 
funds in the school year 1972-73 for 7,452 of their students who made no gains or 
negative gains, and no funds for 13,812 students for whom no records or 
incomplete records were submitted to the Michigan Department of Education, 
in the remaining 66 school districts, the same figures are 7,221 pupils 
making no gains, plus 4,605 pupils for whom there are missing or incomplete records 

In the 66 school districts, among the students having matched pre- 
and posttest scores, 19.63% would have received prorated funding less than 
the $200 per pupil funding level. The same figure for Detroit is 17.01%. 
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Finally, Detroit would have received full funding for 30 ,271 pupils 
meeting or exceeding the 75% criterion. In the 66 other districts, full 
funding would have been provided for 31,865 pupils. 

Section 3 Students Achieving a Minimum of 75% Accomplishment Level 

Students participating in Section 3 programs were enrolled in one of 
three types of programs: (1) combined reading and arithmetic programs; 
(2) reading programs only; and (3) arithmetic programs only. The ranges of 
scores within a district across grades, as well as among districts, varied. 
Tho figures in Table 5 provide information on: (a) all 67 Section 3 
school districts; (b) the state total without Detroit and (c) Detroit Public 
Schools. The tables show the range of percent of accomplishment under the three 
programs. Results for all 67 school districts are presented in Appendix G. 

In Report Number 1, it was found that students in either the reading 
only or the arithmetic only programs performed better than those students 
in combined reading and arithmetic programs; and that students in arithmetic 
programs did better than students in reading programs. This same pattern 
holds true for the state total excluding Detroit Public Schools. The per- 
cent of students who met at least 75% of accomplishment in combined reading 
and arithmetic programs, reading only programs, and arithmetic only programs 
are 68.74%, 73.70% and 76.82% respectively. It should be noted that there 
was a small number of students in grades K-1 in the arithmetic only program. 

In analyzing the 66 Section 3 school districts excluding Detroit by 
grade level, kindergarten and first grade students in reading only programs 
did better than their counterparts in combined reading and arithmetic 
programs and arithmetic only programs. Second grade students did relatively 
better in combined reading and arithmetic programs. Students in grades 3-6 
performed better in arithmetic only programs than those in the two other 




In the Detroit Public Schools, there were only two programs: The com- 
bined reading and arithmetic program, and the reading only program. There was 
no difference in terms of accomplishment level for the two groups of students. 

Thus, the overall pupil achievement pattern in Detroit is different from 
that of the 66 Section 3 school districts. The Detroit students in the 
combined reading and arithmetic program and the reading only program performed 
about the same. However, pupil achievement varied among different grade levels. 
Students in grades 1-3 did better in combined reading and arithmetic programs 
than in reading only programs. Students in grades 4-6 did better in the reading 
only programs than students in combined reading and arithmetic programs. 

In the Detroit Public Schools, Section 3 kindergarten students were 
enrolled in the reading only program and were measured by the Detroit Reading 
Readiness Test. A minimum of at least ten raw score points must be achieved 
by each individual student to indicate one years growth. It was also agreed 
by the Michigan Department of Education administrators and the Detroit Public 
School officials that, irrespective of entry level, each student must achieve 
ten raw score points beyond a predetermined raw score point of *35 in order to 
meet the minimum criterion of success. In other words, if a student scored 
very low on the pretest, the district was required to bring the student to the 
predetermined raw score level of 35 plus the required ten raw score points from 
35. About 70% of Detroit's kindergarten students achieved 75% of accomplish- 
ment level. 

Table 6 shows the aggregate number of pupils: (1) achieving at the 75% 
and above level of accomplishment; (2) achieving at the 1% to 74% levels of 
accomplishment; (3) achieving at zero and negative levels; (4) pupils receiving 
less than 150 days of instruction and (5) pupils having missing data or no 
records. The statistics on individual school districts can be found in Appendix 
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Figures in Table 6 were based on usable student records submitted by 
school districts. In actuality there were 4,101 unaccounted for students 
in cho 66 Section 3 school dlgtrJcts. In Detroit, the unaccounted for 
students came to 13,812. Taking into account the missing data problem, the 
percentages presented in Table 2 would be lower than ttie actual percentages. 
For example, the percent of pupils achieving at 75% and above accomplishment 
for the state total excluding Detroit, Detroit and the state total came to 
53%, 51% and 55% respectively. 

Comparisons of Means and Standard Deviations of Pretest and Posttest Scores by 
Grade Level 

The reader versed in measurement will want to know the results of com- 
parisons of means and standard deviations of pre- and posttest scores by grade 
for each building and district according to test name, battery and level. 
Appendix E provides the correlated t values for grades 3-6 which have at 
least 30 students. Pupils in each grade level within each school district 
frequently made statistically significant gains in reading and arithmetic 
achievement. In most cases, the increase in means was accompanied by a 
corresponding increase in standard deviations. 

The district means in reading and arithmetic tend to be quite stable 
from year to year. Table 7 illustrates this phenomenon in the Lansing Public 
Schools. 

Test results from two Section 3 school districts were used in an attempt 
to compare their Section 3 pupil growth in reading and arithmetic achievement 
relative to the district and national norms. In Table 8, the group means show 
that the Lansing District means are one to eight grade equivalent units lower 
than the national norms, and accordingly the Section 3 group means are two to 
fifteen grade equivalent units lower than the Lansing School District means. 
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TABLE 6 

SUMMARY OF STUDENT ACHIEVEMENT 



SCHOOL DISTRICT 


State Total 
Excluding Detroii 


Detroit 


State Total 


NUMBER OF SECTION 3 PUPILS 


53233 


59267 


112500 




N 


% 


N 


% 


N 


% 


PUPILS ACHIEVING 7S%- ABOVE 


31865 


65.52 


30271 


66.59 


62136 


66.04 


PUPILS ACHIEVING 1% - 74.99% 


9542 


19.63 


7732 


17.01 


17274 


18.36 


PUPILS ACHIEVING 0% - BELOW 


7221 


14.85 


7452 


16.40 


14673 


15.60 


TOTAL 


48628 


100.00 


45455 


100.00 


94083 


100.00 


PUPILS RECEIVING LESS THAN 
ISO DAYS OF INSTRUCTION 
(e.g.. illness, transfer, etc.) 


504 


0 




504 


Missing or Unreported Data 


4101 


13812 


17913 



ERIC 
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Thus, it can be established that, indeed, pupils enrolled in Section 3 
programs have a prior history of low-achievement. Furthermore, the data pre- 
sented in Table 8 illustrate the mean differences according to- national norm, 
district norm, and Section 3 test results over a one year period. Clearly, 
Section 3 students, who had been low-achieving students in the past, did 
almost as well as the average students in Lansing Public Schools during the 
1971-72 school year. 

In order to illustrate that Section 3 students in Lansing Public Schools- 
made better progress during school year 1971-72 than previous years, the fourth 
grade may be used as an example. In May 1971, the pretest was administered to 
those students while they were at the end of the third grade. The district 
average of all Lansing students showed that Lansing students in general were 
about six months behind the average third graders in the nation (3.2 vs. 3.8); 
at the same time Lansing *s Section 3 students were one year and five months 
below the national average (2.3 vs. 3.8). Thus, Lansing Section 3 students 
were nine months behind the average Lansing students (2.3 vs. 3.2). It is 
evident that Section 3 students have not been making the same rate of progress 
compared with the national and Lansing district average rates of growth. 
However, during school year 1971-72, Section 3 students on the average 
achieved the same rate of progress as did the average Lansing students. If 
these Section 3 students could continue this rate of growth in subsequent 
years, the downward trend certainly could be stopped. 

Tests results from Detroit Public Schools also were compared to Section 3 
test results. The number of students in grades 1-6 tested by Detroit Public 
Schools was over 20,000 per grade level. These results for grades 1-6 can be 
found in Appendix E of this report. Table 9 shows that, over a six-month 
period, Detroit Section 3 students at all grade levels, with the exception of 
the first grade, made greater gains in reading and arithmetic achievement than 
the average students in their respective grades based on national norms. 
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Sutnmary 

According to the 1971-72 Detroit test results, 30,271 students made 
at least 75% accomplishment level; 7,732 students made ^ains above zero and 
below 75%; and 7,452 students made no gains or negative gains. In addition, 
there were 13,812 Detroit students for whom no records or incomplete records 
were submitted to the Michigan Department of Education. 

In the 66 school districts excluding Detroit, 31,865 students made at 
least 75% of accomplishment; 9,542 students made gains below the 75% level 
and 7,221 made no gains. Missing data accounted for 4,605 students. 

Comparisons of means revealed that students in grades 3-6 made 
statistically significant gains in reading and arithmetic achievement* 
Two school districts, namely, Lansing and Detroit, were used as specific 
examples. During school year 1971-72, Section 3 students on the average 
achieved at the same rate of progress as did the average Lansing students. 
Section 3 students in Detroit Public Schools made greater average gains 
in reading and arithmetic achievement than average gains made by all 
students in Detroit schools. 
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PART III 

COMBINED RESULTS OF PROGRAM VARIABLES 
ANALYSIS FOR ALL SECTION 3 SCHOOL DISTRICTS - 
EXCLUDING DETROIT 

Statistical analyses of test data and other demographic variables 
were undertaken to determine what influences program variables may have 
had on the achievement of Section 3 pupils. The program variables anal- 
yzed were: (1) type of program; (2) grade level; (3) funding level; 
(4) years of operation and (5) program duration. Only students in grades 
3-6 were included in this analysis.^ The results of the analysis are 
presented below. 

Means, F ratios and associated degrees of freedom are given in 
Appendix F of this report. 

^ Type of Program 

Although there are three program types (combined reading and arith- 
metic, reading only and arithmetic only) in Section 3 schools, most stu- 
dents were enrolled in combined reading and arithmetic (category 1) or 
reading only (category 2) programs. The number of cases falling under the 
arithmetic only (category 3) program was extremely small, therefore only 
categories one and two were used in this analysis. 

The results of the analysis indicated that pupils in grades 3-6 in 
reading only programs made significantly greater gains in reading achieve- 
ment than their counterparts in combing-' reading and arithmetic programs. 



6. Although all 66 Section 3 school districts provided the Michigan Depart- 
ment of Education with data, due to errors in data reporting and problems 
associated with data processing, two school districts (Ferndale and Kalkaska) 
were dropped from the analysis. 



Grade Level 

The average growth gains in reading of all students in grades 3-6 
were 7.8 months (grade 3); 8.3 months (grade 4); 8.9 months (j?rade 5); and 
8.9 months (grade 6). The mean gain scores in arithmetic were higher: 8,9 
months for third graders; 9.9 months for fourth graders; 9.4 months for 
fifth graders; and 9.7 months for sixth graders. There were significant 
differences in mean reading achievement scores across grades. However, no 
significant difference was found in pupil achievement across grades in the 
subject area of arithmetic. The grade level variable seemed to influence 
gain scores in the area of reading, but not in arithmetic. 

Funding Level 

Three funding levels were investigated: (1) funding level 1 - schools 
which received Section 3 money only; (2) funding level 2 - schools which 
received Section 3 and Title I ESEA money and (3) funding level 3 - schools 
which received more than two sources of funding; Section 3, Title I and other 
sources of funding.^ There were no differences in mean reading achievement 
among the three funding levels in pretesting. However, there was a highly 
significant difference in mean reading achievement when the reading mean 
gain scores were analyzed according to funding level. The mean gain scores 
for the three funding levels were 8.2 months for funding level 1; 8.5 months 
for funding level 2 and 5.3 months for funding level 3. 

In the subject area of arithmetic, again there were no differences in 
pretest means, but the mean differences of the average gain scores were found 
to be significantly different. The mean gain for the three levels is 8.9 
months, 10.3 months and 6.7 months. 



7 . A fourth funding level resulted from the fact that a large number of 
schools failed to report the information needed to set funding levels. 
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Years of Operation 

The number of years that a given school building has been receiving 

Section 3 money in each school district varied from one to four.^ The 

great majority of schools reported school year 1971-72 as the first year 

of operation for Section 3 programs. Evidence seemed to indicate the pupil 

achievement in coSibined reading and arithmetic increased with the number of 

years of Section 3 program operation. This pattern is fairly consistent 

9 

if the fourth category (years of operation « 4) is deleted. 

Since there were no significant differences in reading and arithmetic 
achievement by years of operation on the pretest results, the significant 
differences found in mean differences of pre- and posttest results could 
be attributed to treatment effect and possible factors other than years of 
operation, for example, the accountability element implemented under the 
school year 1971-72 Section 3 programs. 

Program Duration 

Program duration means tne elapsed time between pre- and posttest 
administration. It ranged from 6 to 8 months which resulted in three types 
of program duration, i.e., 6 months, 7 months, and 8 months* There was no 
difference in mean reading achievement gains under the three types of program 
duration. There was a highly significant difference in the arithmetic achieve- 
ment. The mean gain in arithmetic scores was 8.9 months for the 6 month 
programs, 10.2 month for the 7 month programs, and 8.8 month for the 8 month 
programs . 

Except for the fact that pupils made higher gains in the 7 month programs, 
there was no consistent direction concerning the effect of program duration 

8 Some school districts received money under the previous Michigan Compensatory 
Education Program. 

9. A large number of schools failed to report years of operation for Section 3 programs. 
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on pupil achievement. 

In addition the mean differences of the pre- and posttest scores of a 
number of comparable school districts using the May to May testinp, vs. the 
September to May testing were compared. No consistent direction favoring 
either method of testing was found among the school districts. This will 
be pursued further using larger sample size and other measures of control 
for the 1972-73 Chapter 3 evaluation report. 

Summary 

In this section, pupil achievement in all Section 3 school districts 
- excluding Detroit — as it relates to type of program, grade level, fund- 
ing level, year of operation and program duration was presented. 

The results showed that students in reading only programs made greater 
gains in reading than those students enrolled in combined reading and 
arithmetic programs. 

There was a statistical significant difference In means across grades 
in reading, but not in the area of arithmetic. 

There were significant differences in mean gains across funding levels 
in combined reading and arithmetic achievement. However, there was no con- 
clusive evidence indicating that an increased funding level wx)uld result in 
higher pupil achievement. 

Years of Section 3 program operation varted from one to four, and 
evidence seemed to indicate that pupil achievement in combined reading and 
arithmetic increased with the number of years of program operation. 

Program duration ranged from 6 to 8 months. While no difference was 
found in mean reading achievement gains according to program duration, there 
was a highly significant difference in the arithmetic achievement. Students 
in the seven month programs made higher gains in arithmetic achievement. 
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PART IV 

RESULTS OF PROGRAM VARIABLES ANALYSIS 
FOR THE DETROIT PUBLIC SCHOOLS 

There are 234 Section 3 schools in Detroit Public Schools, dis- 
tributed in 8 regions. Detroit Public School officials reported that 
there was no central coordination of Section 3 programs; principals gen- 
erally enjoyed complete autonomy. Furthermore, p ams underwent constant 
changes, from school year to school year. 

Due to the large number of schools involved and diversity of pro- 
grams, the Department of Education staff and the Detroit Public School 
administrators currently are exploring ways to identify promising programs. 
The Detroit Public Schools have evaluated a number of identified projects 
within the district and found little consistent pattern in terms of program 
effectiveness relating to pupil achievement. A total of 24 schools were 
identified by Section 3 staff in Detroit, 12 top performing schools (growth 
of two years and above) and 12 schools with the lowest mean gains (1/2 year 
and below) . 

A graphic presentation (Figure 3) shows that, over one academic year, 
the range of achievement among the regions ran from a gain of 7.4 months 
to 12.2 months in reading and 6.3 months to 9.2 months in arithmetic. 

The Detroit Public Schools used the Paragraph Meaning subtest of 
the Stanford Achievement Test for the measurement of pupil reading, and the 
Mathematics Concepts and Mathematic Problem Solving subtests of the Iowa 
Test of Basic Skills for the measurement of pupil arithmetic achievement. 

Type of Program 

The reading achievement gains o£ Detroit Section 3 students in grades 
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3-6 enrolled in the combined reading and arithmetic programs or the 
reading only programs were not found to be statistically significant. 

Grade Level 

A careful examination of the pretest reading achievement of Detroit 
Section 3 students across grades 3-6 revealed that the third graders on 
the average were eight months below the national norm, the fourth grade 
students were 11 months below the national norm, the fifth grade students 
15 months below, and the sixth grade students 17 months below. It should 
be noted that students in all four grade levels made eight or nine month 
gains in reading; in other words, they all made better progress in read- 
ing than they had been doing in previous years, but were still below 
their ^rade level. There was no significant difference in reading 
achievement when the reading gain scores were compared across grades. 

In the subject area of arithmetic, the pretest arithmetic achievement 
scores revealed that students in the third grade, on the average, were 7 
months below the national average, the fourth graders were 9 months below 
grade average, the fifth graders were 11 months below grade average, and 
the sixth graders were 14 months below grade average. Again it was found 
students performed uniformly across grades. On the average^ students made 
between seven and eight month gains across the four grade levels. 

Funding Level 

The great majority of Detroit schools reported funding level data; 
that is, building programs funded from Section 3 only (funding level 1), 
from both Section 3 and ESEA Title I (funding level 2) , and from Section 
3, Title I and other sources (funding level 3). Pretest pupil achievement 
in reading did not reveal any significant differences in means among , 
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the three funding levels. However, the reading gain scores under the 
various funding levels were found to be highly significant. Students 
In I'undlng level three m;Rlc u gain of 10 months In reading; those in 
funding level two made nine months gain and eight months gain was made 
by those in funding level one. In other words, evidence indicated that 
in Detroit, funding level did make a difference in pupil achievement. 

In the subject area of arithmetic, pupils in the three funding 
levels seemed to perform equally well. 

Years of Operation 

All Section 3 schools in Detroit reported school year 1971-72 as 
the first year of program operation, therefore no analysis was made under 
years of operation. 

Program Duration 

Detroit students were mostly in the six months Section 3 program, 
with a small number of students in the seven months program. The former 
group performed better in pretesting than the latter group. However, an 
analysis of the reading gain scores reversed the trend. 

In the subject area of arithmetic, students in each program (i.e., six 
months and seven months duration) performed about the same on the pretest* 
However, analysis of the arithmetic gain scores between the two groups 
revealed a highly significant difference in pupil performance favoring the 
seven months program. 

Summary 

In the Detroit Public Schools, Section 3 students enrolled in the 



10. Detroit Public Schools had received money under the previous Michigan 
Compensatory Education Program. 
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combined reading and arithmetic programs or reading only programs were not 
found to be different in reading achievement • 

There was no difference in reading and aritlimetic achievement painfi 

across grade levels . 

When funding level was analyzed, students made greater - 3 in read- 
ing with increased funding level. 

The results also showed that Detroit students in the seven month pro- 
grams made greater gains in reading and arithmetic than those in the six 
month programs. 
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PART V 

COMPARISON STUDY OF HIGH ACHIEVING AND LOW ACHIEVING SCHOOL DISTRICTS 

A comparison was made between the ten school districts with large 
percentages of students achieving at the 175% and above levels of accom- 
plishment and the ten school districts with large percentages of students 
achieving at the 50% and below levels of accomplishment. 

The high and low school districts shown in Figures 4 and 5 were selec- 
ted based on one criterion, namely percent of accomplishment by rank order. 

A comparison of the instructional process of the high and low achieving 
districts was hampered by the lack of quantified data and anecdotal records. 
On-site visits by- Michigan Department of Education staff and local Section 3 
project people often revealed the protean nature of various programs within 
the districts. The "Hawthorne effect" often can cloud the objectivity of 
the observation. 

In making the high /low comparison, four general program components were 
considered: 

1. Program logistics — considered the extent of time commitment, 
the size of the learning unit (or pupil/teacher ratio), and 
the degree to which the program functioned as an assimilated 
(a part of the regular classroom process) versus an extraneous 
instructional unic. 

2. Program personnel — considered the intensity of "people re- 
sources" committed to the pupil or instructional unit, as well 
as what kind of resource, i.e., teacher aides, reading special- 
ists, auxiliary teachers, consultants, coordinators, and uni- 
versity consultation. 
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3. Instructional materials — considered what kinds of 
instructional resources were utilized by the program, 
i.e., multimedia, programmed materials, visual aids, 
a learning resource center, etc. 

4. Instructional process — assessed what kind of instruc- 
tional process was ^atilized by the program, e.g., indi- 
vidualized instruction and assessed the extent of sys- 
tematic interaction of the process components and people, 
i.e., diagnostic screening, assessment of pupil's defi- 
ciencies and learning styles, program prescription and 
feedback (evaluation and reinforcement) . 

Program Logistics 

The amount of instructional time committed per week appeared to be 
equivalent between the high and low achieving districts. However, there 
appears to be more of a tendency for high achieving districts to utilize 
extraneous small groups instead of assimilating the program into the reg- 
ular classroom instruction. 

Program Personnel 

The high achieving districts tended to utilize coordinators or consul- 
tants to facilitate coordination and inservice training for the teachers* 
The low Achieving districts tended more toward parallel personnel, i.e., 
remedial or auxiliary teachers, rather than supervisory personnel. Both 
groups utilized teacher aides. 

Instructional Materials 

Several districts in both groups mentioned utilizing learning resource 
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centers. All districts utilized various multi-media, programmed materials, 
etc. 

Instructional Process 

Nearly all districts recognized the need to relate instructional 
materials to student deficiencies or disabilities as stated in program des- 
criptions. More high achieving districts mentioned the role of a student 
learning style in planning the pupil's instructional program. While the high 
achieving districts made more frequent reference to diagnostic screening, 
most of the districts were utilizing some form of individualized instruction. 

While both groups mentioned the role of feedback for evaluation and 
reinforcement, more high achieving districts acknowledged this component 
and emphasized the role of reinforcement (reward/praise). 

Problems with the Quantification of Program Descriptions 

The program descriptions were obtained from the 1971-72 Section 3 
program applications. The instrument used to obtain program descriptions 
contained only two general categories — organizational characteristics and 
instructional strategn . These were essentially open-ended response formats 
Such a format presents great difficulties for data interpretation in that 
omission of program components can easily occur. 

The second major problem in attempting to quantify the program descrip- 
tions was the use of educational concepts in broadly stated terms. The 
following are coiranonly used concepts whose exact meaning would seem to be 
in question due to generalized usage. 

1. Learning centers — what population uses the center, a classroom, 
an entire school? What kinds of resources, interest and ability 
levels are included in the resources? Is this comparable to a 
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library, a lab, self-study? 

2. Programmed materials — does this mean a precise, sequential and 
objective instructional format related to the learning deficiencies 
of pupils? 

3. Learning style — to expect definitive information on this concept 
may be an unreasonable demand since districts were not asked this 
question specifically. However, it may be a potential key to 
differentiating how effectively teachers and districts are dealing 
with various learning processes. 

Perceatage of Section 3 Monies Expended 

Although each of the Section 3 school districts was not required to 
submit a budget at the beginning of the year, all Section 3 school districts 
submitted a summary expenditure report at the end of the school year 1971-72. 
Since districts had complete autonomy in the expenditure of funds, it is 
assumed that the summary expenditure reports accurately reflect monies expended. 

The itemized expenditures of the high achieving and low achieving dis- 
tricts are presented in Tables 10 and 11. 

It appeared that the high achieving and low achieving districts spent 
the Section 3 funds in a similar fashion. That is, approximately 50% in 
salaries for instruction, 15% to 20% in teaching supplies and other instruc- 
tional equipment, aad 10% to 15% in instructional equipment. However, there 
are some differences between the two groups; the high achieving group tended 
to spend relatively less in salaries for instruction, textbooks and instructional 
equipment, and more in the areas of administration, supplementary materials 
and school libraries. 

One school district in the high achieving group showed a completely 
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ditferent pattern of spending from the rest of the population; it spent 
71.05% of its total allocation on construction and non- instructional equip- 
ment and 19.60% on supplementary materials. Another school district sub- 
mitted an incomplete financial report. Aside from these two exceptions, 
spending patterns were closely matched between the high achieving and low 
achieving groups of districts. 

Summary 

Comparing the high and low achieving districts, there is great simi- 
larity between concepts and processes utilized. The differences between 
groups must derive from the specific operations veiled behind the general 
concepts stated by the districts. For example, the written descriptions 
give the general impression of equivalence of process, i.e., use of indivi- 
dualized instruction, use of programmed materials, etc. However, the high 
achieving districts seemed more structured and more organized in relating 
student's deficiencies and learning styles to program prescriptions (or 
programmed materials) , and then following up with pupil/teacher consulta-r 
tion for feedback, i.e., evaluation and reward. Both groups may be equiv- 
alent on this process, but the high achieving districts seemed to stress 
the specific pupil deficiencies. 

In contrast, some of the low achieving districts were more ambiguous 
in meeting student learning deficiencies. Their strategy sounded more 
hit-or-miss, i.e., "we're using a variety of supplemental texts, materials, 
media, etc." Such an approach would appear less geared to dealing with 
learning deficiencies than structured and sequential programmed materials. 
Assuming that reading and arithmetic are structured systems, then pref- 
sumably deficiencies in learning these systems could best be met by utilizing 
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a structured, systematic program or materials. Thus while more intangible 
program components were mentioned, e.g., much love and understanding, or 
emphasis on materials relating to individual interest, these aspects seem 
more related to student receptivity, and may not move beyond to meeting 
and countering specific deficiencies. 

The itemized expenditures of the high and low districts revealed that 
the spending patterns were quite similar. It appears that the manner 
in which the funds were spent ~ at least in terms of the expenditure cate- 
gories utilized in this report ~ may not have direct impact on pupil achieve- 
ment. 
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PART VI 



DISCUSSION AND RECOMMENDATIONS 



Description of Data Collected 

During school year 1971-72, the 67 Section 3 school districts were 
funded for a total of 112,500 pupils. The schools submitted 101,198 pupil 
records; there were 94,083 students, or 93% with matched pre- and posttest 
scores . 

The problem of "regression-to-the-mean" was taken into account by 
requiring that students be given a pretest after they were selected for 
participation in the programs based on achievement test results. 

Recommendation Number I 

It is recommended that in the future the quartile range 
be charted in order to compare the percentages of students in 
each quartile on their pre- and posttest scores. This can be 
performed on the building, region or district level for any 
grade level. A study of this nature may reveal how various 
programs affect the high, middle and low achieving students. 
In addition, the statistical phenomenon of regression-to-the- 
mean should be investigated. In order to answer the question 
whether students with low pretest scores gained more than stu- 
dents with high test scores, each grade within each district 
can be divided into thirds based on their pretest, and gains 
can be computed for each of the subgroups. 

It is predicted that the problems of missing data and unaccounted 
students will not be completely eliminated for the second year of the 
program* However, due to a number of preaudit and audit procedures 
established to facilitate the update of information sent in by school 
districts, these problems are expected to be reduced considerably in 
magnitude. In addition, procedures were set up zo check the accuracy of 
test scores. Most Important of all, emphasis must be given by local 
school districts to following carefully the instructions prepared by the 
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Michigan Department of Education and to checking data thoroughly before 
submitting it to the Department, 

Discounting the large number of unaccounted students in Detroit, 
Beecher , * Pontiac, Saginaw, Flint and Willow Run, the data were considered 
representative of the 740 participating elementary school buildings in the 
67 Section 3 school districts • 

Recommendation Number 2 

It is recommended that school districts establish some 
kind of system to facilitate the validating and checking of 
test results either based on individual classrooms or build- 
ings • In addition, the relevancy of test« used should be 
carefully scrutinized by the districts • Both internal and 
external checks on test scores should be performed to insure 
the accuracy and validity of the data. 

It is difficult for the school districts to engage an outside agency 
to audit results. In addition, it is also a sensitive issue, for apparently, 
not too many administrators are willing to follow through with this process. 
However, this is an important and necessary step in implementing account- 
ability in the schools. An alternative route should be considered. In 
some school districts all students are tested under district testing in 
the fall, however, only certain students are tested in May (e,g,, students 
in Section 3, Title I ESEA programs). It is highly desirable that districts 
test the students under similar test conditions for both pre- and posttesting. 

Under the present set of Section 3 rules, it is possible for some 
students to be tested in May-June of each year. The posttest scores of 
school year 1971-72 can be Uoed as the pretest scores of school year 1972- 
73, provided that the identical or parallel form of the test be administered 
to the students in May, 1973, 
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The status of pre- and post test pupil achievement was presented. In 
some districts, some students were found to be performing on or above grade 
level upon posttesting. The question here is not only that these students 
should be studied, but also whether these students should be removed from 
the Section 3 program and thus make room for those students who do not per- 
form to grade level. If they were locked in the program for the entire 
three year cycle, then, it would be illuminating to do a follow-up study 
on these students. In addition, there is a real need for process evaluation 
on the local district level. 

Recommendation Number 3 

Within each school district, evaluators should study the 
delivery system of those buildings in which large numbers of 
students were found to make one, two or' more years gain in 
achievement over a one year period # and those who failed to make gains. 

The spending patterns of most Section 3 school districts were found 
to be quite similar; 60% of their allocations was spent on salaries for 
instruction and in-service training, approximately 30% of the money was 
spent on materials, 3-5% on facilities and 4-5% on administrative services. 
The "1972-73 Budget and Staff for Section 3 Program" will yield essentially 
the same kinds of information. However, the form was modified so that 
school districts were also required to provide information on Section 3 
staff in terms of full time equivalency to the nearest whole number. In 
other words, in the 1972-73 evaluation report, it will be possible to 
provide answers to questions pertaining to the number of additional staff 
hired with Section 3 money. 

Recommendation Numbe:: 4 

In order to obtain more meaningful information and do a 
creditable job in analyzing financial data, it is recommended 
that school districts, particularly the larger ones, file their 
summary expenditure reports on the building level in the future. 
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Descrlptlon of Section 3 Students Achievement in Reading and Arithmetic 

It is conservatively estimated that in Detroit Public Schools missing 
data accounted for over 20% of their students. In the remaining 66 school 
districts, missing data accounted for xO% of the total population. The 
Michigan Department of Education, Section 3 evaluation staff has set up 
procedures and is working vigorously toward the elimination of the missing 
data problem, thus reducing the number of students who will receive no 
Section 3 money for the third year of the program for reasons other than 
achievement. It is hoped that local education agencies will share this 
responsibility. These figures should also provide food for thought about 
alternative uses of the "surplus" money which invariably will accrue in 
school year 1972-73. 

The distribution of pupil achievement ranged from zero and below to 
300% and above accomplishment level. In the combined reading and arithmetic 
programs, approximately 69% of the students in the 66 Section 3 school dis- 
tricts excluding the Detroit Public Schools met at least 75% of accomplish- 
ment level. One hundred percent accomplishment level means one month gain 
in reading and arithmetic for each month in the program. Approximately 74% 
of Section 3 students enrolled in reading only programs met at least 75% of 
accomplishment level; and 77% of the students enrolled in arithmetic only 
programs met this goal. 

In the Detroit Public Schools, approximately 66% of their Section 3 
students achieved at least 75% of accomplishment levels in the combined 
reading and arithmetic programs and reading only programs. 

Since school districts would not receive a bonus if the gains were 
above 75%, there is a priori reason to believe that students achieving 
above the 75% level of accomplishment were gains actually made by the 
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students • Therefore, it would be revealing to study why these supposedly 
low achieving students were able to make spectacular gains. A follow-up 
study on these high achieving students for the second and third years of 
the program is necessary to ascertain the retention power. 

Comparison of means showed that students in grades 3*6 made statis- 
tically significant gains in reading and arithmetic achievement. Lansing 
Public Schools and the Detroit Public Schools provided district test results 
for analysis on the district level. During school year 1971-72, Section 3 
students on the average achieved at the same rate of progress as did the 
average Lansing students. Section 3 students in the Detroit Public Schools 
made greater average gains in reading and arithmetic achievement than the 
average gains made by average Detroit students. Further analysis is recom- 
mended in order to compare the performance of Section 3 students with other 
students not in the Section 3 programs. It should be noted that there are 
no comparison groups (control groups) within each school district, since 
Section 3 students comprised the lowest achieving students in each school 
district distributed across grades K through 6 in all elementary school 
buildings. 

Combined Results on All 67 Section 3 School Districts 

Pupil achievement as it relates to type of program, grade level, fund- 
ing level, years of operation, and program duration in the 66 Section 3 school 
districts, as well as in the Detroit Public Schools, were presented. It 
can probably be assumed that most of the Section 3 students in the 67 school 
districts are in combined reading and arithmetic programs in the school 
year 1972-73. 
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Section 3 school districts will undoubtedly provide more complete 
information on funding level and years of service in the future. Further- 
more, additional information on summer school programs, program duration 
and program description will probably shed more light on the Section 3 programs 
of the school year 1972-73. 

High and Low Achieving School Districts 

There was great similarity between concepts and process utilized when 
the high and low achieving school districts were identified and studied. ■ 
The high and low achieving districts were selected according to one cri- 
terion, that is, pupil achievement. Problems encountered in the analysis 
of program components, derived from program descriptions submitted by the 
school districts, were numerous. The financial reports submitted by school 
districts did not shed much light in terms of. its impact on program effec- 
tiveness. 

Recommendation Number 5 

In order to ascertain what caused the improvement or failure 
of pupil achievement, the planned educational delivery systems, 
the relationship between costs and the delivery systems should be 
carefully studied. 

Needless to say, process evaluation should be a paramount concern of 
local school districts. Evaluation should not be confined to the indenti- 
fication of successful and unsuccessful buildings based solely on the cri- 
terion of achievement, but also the conditions under which they operate. 
In order to facilitate process evaluation, quantitative and ancedotal 
records must be kept on the class and/ or building level. 
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APPENDIX A 

Number of Students Achieving Less Than One 
Year Below Grade Level on the Pretest Grade 
Scores and Number of Students Scoring on or 
Above Grade Level on the Post test 

Pages 62 Through 65 
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APPENDIX B 

Number and Percent of Students, by District 
Name and Code Number, Achieving a Certain 
Percentage of Accomplishment^ 
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APPENDIX C 

Number and Percent of Section 3 Students 
/Achieving a Minimum of 75% Accomplishment, 
and Number of Matched Pre- and Posttest 
Scores, as Measured by Standardized Achievement 
Tests, by Grade Level, by District 
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